Web Survey Bibliography
There are many ways and different terminology used to compute metrics such as response rates for online panels. In a recent effort, the Advertising Research Foundation is promoting an online quality research council to work on different quality topics; one such topic addresses metrics for online panels. This paper starts by reviewing the different metrics proposed by survey and market research associations such as the European Society for Opinion and Marketing Research – (ESOMAR), the European Federation of Associations of Market Research Organizations (EFAMRO), the Interactive Marketing Research Organization (IMRO), and the International Organization for Standardization (ISO) for online data collection. We ground the discussion on the distinction between probability-based online panels and opt-in or access panels. After describing the data collection stages for a prerecruited probability-based web panel and for an opt-in panel, we propose some measures for response, refusal, attrition, and re-interview rates and the relevant formulas. We use concepts derived from existing AAPOR standards for web survey response rates. Complex design and weighted response rates are also addressed. We conclude with a discussion of which metrics can be used with a specific online panel (probability-based or opt-in) and debate the meaning of the different metrics and the relationship between response rates and survey quality.
Homepage (abstract)
Web survey bibliography - DiSogra, C. (16)
- Metrics and Design Tool for Building and Evaluating Probability-Based Online Panels; 2015; DiSogra, C.; Callegaro, M.
- Cell RDD Respondents Unmasked: Progress Report on Geo and Demo Appends to the Wireless Frame; 2015; DiSogra, C.; Kennedy, C.Mosher, M.
- Using Probability-based On-line Samples to Calibrate Non-probability Opt-in Samples; 2012; DiSogra, C., Cobb, C. L., Chan, E., Dennis, J. M.
- Seasonal Yield Variation and Related Response Patterns in Address-based Mail Samples; 2011; DiSogra, C., Hendarwan, E.
- Observed Differences in the Placement and Wording of Neutral Response Options in Web Surveys: An Experiment...; 2011; Walton, L., Cobb, C. L., DiSogra, C.
- Calibrating Non-Probability Internet Samples with Probability Samples Using Early Adopter Characteristics...; 2011; DiSogra, C., Cobb, C. L., Chan, E., Dennis, J. M.
- Address-based Sampling Nets Success for KnowledgePanel® Recruitment and Sample Representation; 2010; DiSogra, C.
- Results of Targeting Pre-Identified Minority, Unidentified Non-Internet and Vacant Homes in Two National...; 2010; DiSogra, C., Hendarwan, E.
- Maximizing a stratified ABS frame for nation-wide mail recruitment of a probability-based online panel...; 2010; DiSogra, C., Hendarwan, E.
- Using an ABS frame to recruit a probability-based online panel; 2009; DiSogra, C.
- The Challenge and Importance of Including Spanish- Dominant Latinos in Online Panel Studies Addressing...; 2009; DiSogra, C., Wells, T., Torres, J.
- Do we hear different voices?: Investigating the differences between internet and non-internet users...; 2009; Zhang, C., Callegaro, M., Thomas, M., DiSogra, C.
- Panel Conditioning and Attrition in the AP-Yahoo! News Election Panel Study; 2009; Kruse, Y., Callegaro, M., Dennis, J. M., DiSogra, C., Subias, S., Lawrence, M., Tompson, T.
- Recruiting Probability-Based Web Panel Members Using an Address-Based Sample Frame: Results from a Pilot...; 2009; DiSogra, C., Callegaro, M., Hendarwan, E.
- Computing Response Rates for Probability-Based Web Panels; 2009; DiSogra, C., Callegaro, M.
- Computing Metrics for Online Panels; 2008; Callegaro, M., DiSogra, C.